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CTRATIgTICJAN A^JD OTHER SPECIAL EDUCAtlON ^DELIVERY 
"S-^MODEI^S: CHANGES OVER TIME IN^ TEACHBR RATINGS', ' 
.1 ^SELF-IMAQE, PERCEIVED CLASSROOM CLIMATE AND 
• AGABBMIG-AGJtlfeVE;MBNT--?^NG-mNpK^ 

nonhandicApped children 



) ^ / Introduction * ' ^ % 

In t^e autumn of 1973, the Rocky' Mountain Regional Resource Center 
(RMRRC) in Salt Lake City, Utah, initiated a research prograi^i to aid. in 
evaluating the impact on the perceptions and achievement of handi-capped 



school children^ ana of certain special education teachers who had Received 
/^Xevious extensive training and experience under the aegis of the staff of 

th^ RMRRC. Irhese teachers had been trained to function in the ppblic 

/ . ' ^ ' , 

schools as "st^atistiaian -generallsts , " a nSw job concept in the education 

. ' t^ ' * • ^ 

^oFTianfiicapped ^ildren. The person filling. this role serves primarily as 
a* resource to the regular classroom teacher,/ and thus as an intermediate 
link between the teacher and the various services a^rail'^le to the 'schools. 

1 

The, concept of the stratistician-generalist 'complements, where operational/ 

r 

jiiie work of. the more traditional special education teacher who manages a 

self-contained classroom or a resource room where children with various 
^ . . ^ . ^ . . '\ 

kinds of problems receive specialized educational services. The work of the 

st^atistician-generalist is ongoing throughout t^e school year and includes 
. activiti^s^^of direct* assistance to cT^assroom teacrhets, resource room i 
teachers, special Class teachers, and to local school a^d district admin- 
istrators; i In addit.ion, during the resear6h phase of the project, st^atis- 
tician-generalists a^so provided coordination an^- implementation of RMRRC 
programs in th'fe public schools, ^ . ' . 

^ To search foa:^the effects of a specif? education resource to 
teacjifers (stratistician-geoeralist) in certain of the public schools of • 




,'the RMRRC staff undertook a progj^-am of data -collection at two points 
in time (i.e., Autiainn and Spring) during the 1973-74 school year. The 



general questions, to be addressed and answered in this analysis follow: 

I. At the beginning of the school year, what are the relation- 
ships between, a set of responses, to r.eliable measures* of : 
a. teacher ratings o^ the student ^ 
br student perceptions' of - himself 

c, student perception^ of classroojn climate j , 

d. achievement test scores, and 
the student's 



1.^ .grade level 



3. classification as handicapped or nonhandicapped? 

• . ' 

II. For the measures in I above, wh^t relationships remain and 

what 'hew 'relationships emerge when th^'se same , data ar^ again* 
^Millected and analysed at the end of ^ the school year? That 
is; after scores -from the first of the year are included in • 
th"e 'Second analysis as a covariate control, what differences 
^rom the first 'analysis still remain at the Second analysis ^ 
and What new' dif felrences emerge? ' 
III. When only scores of handicapped children are analyzed, / / 
what relationsnips emerge at the first and second measure- 
ment periods between the" stiid^nt's scores and his , ^ . 

^ a. grade , ^ w 

b. sex, and ^ • 

c. expospre to the type of special education resource ^ 



i 



3. - . 

^ program operating in his school? 
While the major research que.stion pertains to the relationship 



between .these scores 'and the student's exposure to the stratistician- 



X . ^ _ _ _ 

generalist program, it is of irop ortant„educational int^rest to ex4inine~diilt:r- 

ences between handicapped and nonhandicapped , children as^well, and look at^ 

the, pattern of differences which* occurs when\ grade level and s.ex are used 

• I' 

a^s a^ditJ.onal grouping variables, ' * 

Method 

* Subjects f School^ and pistrictsV -- 
• * At the begii\ing of the 1973-^74 school year, the RMRRC placed 



17 specially trained sjzratistician-generalists in 17 schoo^ls which represented 

r 

11 of the 40 school districts in the s^ate of Utah, In addition, two con- 
trast schools were selected (Buf fmire , -1974) The student subjects included 



all students jga grades 1 through 6 in the participating school^,, Approxi- 
mat'ely 300 teachers participated in completing one of the measures used in 
the analyses reported here, and in adminstering the remaining measures to 

the SLtudents.' Complete data for all the instruments used in thpse analyses 

'J 

were foui>d for 342 handicapped and 202 nonhandicapped children cp. the social- 

emotional scales and for 314 handicapped and 1,454 nonhandicapped children 

on t^he achievement: €est data. ^ > - ^, 

^ -I -Jji • . ' ' 

Designs , * 

I The design used for the first set^. of analyses betWeeiy^andicapped 
and nonhandicapped children at both the ^^ginning and at the epd^of the 
1973-74 school year was a 2 x i2 x 2 factprial.' The desigh fact^^rs for these 
first analyses were as follows: 



1. Handicapped/nonhandicapped ^status 

2. Sex 




3.* Giiud 



The social-einotional^pales a nd/achiey<^e nt tests *us ed in ti^iis 



first '*set of analyses were adapted^rom ^ome of "thos^ used in a previous 
large scale -study in Texas* called Project PRIME (Kaufman & Agkrd, 1973). 
The results of tho^nalyses of jO^ achievement test date will be reported 
following the analyses of the socxal-emotional scale data. These social- 



-emotional scales^ whi^h will be desci^ibfed in the next . section, were 



C ■ 



labeie^J as follows! 

1. J Teacher Rating Scale 

2. About You and Yuul' Friends 

3. Your School Days " , 

The complete factorial for the first set of analyses is illustrated 
in Figure 1. r 

4 



The design used for the second .set of analyses at both the begin- 
ning and the end of the r973^74 school year^was a 4 x 2 x 2 factorial. This 
design analyzed only the data for handic^ped children. The design factors 
for the second analyses were as' follows t ' . ^ ' 

i. Special education program status: * 

l ^ . 

a. traditional resource room, N '= 7 schools ' ^ 

b. combination resource room/stratistician, N = 7 schools 
^ Cv stratistician^generalist, K = 3 schools 



2. . Sex 



d. contrast schools- (no RMRRC involvefnent) , N = 2 
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The comple 
in Frgnre 2. 



3, Grade leve) : grad4;s 1-3 or 4-6 

te factt)rial f^)r the second set of analyses is s 

1 



hown 



0 ^ 





- ♦ 



■ ( 





Grade 
lev^l 


' i 

Handicapped ) Nonhandicapped * 
Male Female . Male Female ^Xotals ! 


Grade 
1-3 


\. i * 1 ' i 

, 127 58 r 36 , 42 ' 263 


Grade 
4-6 


97 . 60 
^. n 


r • » f - ■■ ■ - 

1 -j 

62 62 • ' 2^1- ^ 


Totals 


Ilk 118 


t \ 

98 ;• • 104 • I- 544 / 
1 ^ 



Figure 




/ 



1. Design for analysis of diffsnenced between handicapped and non- ' 
handicapped students, J^y sex and grade level. 



ERIC 



12 . 



6. 



y Tvoe 

"Resource 
Rcon 

Strat. 
Strat 

Contrast 



33 



26 



17 



.31 
28 



'1-^ 

19 

20 



TOTALS. 



110 



29 UO 
13 •• 73 



49 



To.tals . i 127 



97- 



58 



60 342 



J V 



Figure 2. Design for aralysis of differences for handicapped students 
between program, sex anc 
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Variables '^ 

•With th6 exception of the Metropolitan Achievement Test, all 
measiires used as criterion variables in these analyses were adapted from 
the Project PRIME study conducted' in Texas. Three of these instr\imer>ts were 
used in the data collection of the present RMRRC study; the scale structures 
and factor analytic methods used in developing them are found in various 
Project PRIME working pai)ers published by the project (Veldman, 1974) . 
Figure's lists the variables derived from the^se y^struments. 

Teacher Rating Scale (TRS ) . 

This instrument is a five-point rating scale completed by the teacher 

f ■ * * 

on^ the target student and consists of 85 items which yield scores on four * 



factor scales labeled as follows: 



a. Needs Supervision /e.g., student is seen to "need cons 

' ♦ * 

supervision" to "finishes on time*'),; 

b. Misbehavior (e.g., "attempts to dopdnate or bully other chil- 
dren" ta "is well behaved in school"); 

c. Outgoing , Expressive (e.g., "is spontaneous in contributing 
' ideas" to "contributes to class discussion") ; 

d. Anxious, Depressed (e<rg^, "becomes upset when msikes a mis- 
take" to "expresses feelings of inadequacy about self"). 



MxDut You and Your Friends (AYYF) . y 

' ' This* instrument was administered to\the student by the teacher, with 
the student responding "yes" or "no" on his answer sheet. TJie instrument 
consists of 96 items in the general area of perceived self-image and provides 

r * • 

four factSr scale scores as follows: 

a» Loneliness and Rejecticj^ (e.9.,*"ls it hard for you to make 



8- • . / 

» - 



• 

Variable 
Nufaber 


Description ' 


— 

Instrument 


• * 

Data 
Supplied By 




Needs Supervision 


-» 


- 


2 
3 
4 


Misbehavior 
Outgoing, Expressive 
Anxiou§, Depi*es3ed 


' Teacher Rating 
ocaie 


Teacher.- 


5 


Lpneliness *and Rejection 






6 


Enjoys School , 






'7 
8 


Does Well i^School 
Misbehavior 


About You and ' 
Your Friends 


Child 


Q 


Enjoyment, Positive * 


1 




' c 


Reinforcement 


• • 




10 

11 


4Jiihappine&s , Misbehavior 
Cbgnitive Emphasis 


Your School Days 
# 


Child 


12 


Variety, Individualization 







Figure 3. Vatiable names and-sources 
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friends?;;' "Do your classmates make fun of you?") ; 



b. Sf>5oys Schooi^ (e.g., "Do you like school^-" "Is school' 
interesti'tvq: t^) you?"); ' ^ • . 

c. Does Well in'Sctiocd {e.§. , '"Are Vod smart?" "Do you .write' 

good stories and reports?^T7^ ' ' , . 

" ' V ^ * 

d. Misbehavior . ("Do you get intcb?^, trouble in school?" "Do you 

fight too much?") . • . 

Your School Days (YSD) ' , ' " ♦ I 

kn instrument designed to measure student perceptions of classroom 
•climate, it consists of 65 questions to which each student responds by writing 
"yes" or ""no" in his amswer booJclet. Follpwing a four-factor rotation, the 
following scales were derived: , • w< »- 

a. Enjoyment, Positive Reinforcement (e.g., "Do the children ^njoy 
their school work in your class?" ->"Does your teacher reward you 
when you do good work?"); 

, ^ / 

b. Unhappiness, Misbehavior (e.g., "SreTiost of the children unhappy 

• » 
in your class?" "Ar^e ,the children in your class alway^ fighting 

with $ach other?"); ^ . ' 

Cognitive Emphasis (e.g., "When your tteacher asks you a ques- 

tion, is it important to* give reasons for your answers?" *^Does 

A * 

^ your teacher t,ell you reasons why you shouldn't do something?") 7 
d. Varied, Individualization /(e.'g. "Do different projects gp-on 
at the. sajneu'"tinfe in your room?" "Can you use the class games 
and learning equipment without the teacher watching you?") . 
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Metropolitan Achievement Test. (MAT ) 

The MAT contains' forms for' four grade levels: Primary I, Prin><trv II,' 

Elementary and' Intermediate . Subtests include: Word Knowledge, ^Word Analysis 

(PI and pn only), Reading, Total Reading, Mathematics Conj^tation (PII, 

Elementary and Intermediate only), Mathematics Concepts (PII, Elementary 

♦ 

and Intermediate only), Math^atics Problem-Solving (PII, Elementary and 
Intermediate only) , and Total Mathematics^ The scores used in the analyses 
reported here (see R?ge 54) are grade equivalents for the four subtests of 
Word Knowledge, Reading, Total Reading and Total Math only. ^ 

Data Analysis and Results 
The data were analyzed By means of a multivariate analysis of 
variance (MANOVA), computer program devised by Clyde, Cramer and Sherin / 
(196S). The MANOVA program provides multivariate F tests for the hypotheses 
pertaining to the effects of the design factors and their interaction on 
the variables. The significance of aay multivariate root*is tested by the" 
Wilks-Lambda criterion. If one or more multivariate F rat:^s associated 
with a design factor or interag^on among design factors is significant, 
this indicates, among other things, that when all the variables are combined 
*to form a multivariate dimension, that dimension asjsociated^^with the signif^- 
cant mu.ltivariate F test provides maximum discrimination among the subject 
groups creatfed by the design factor in question.^ This multivariate dimfensxon 
is referred to in the MANOVA program'^as a ^'principal component of the 
hypothesis." It consists of a certain combination of all the variables and 
can be labeled by noting which of the separate variables receives the high- 
est "weight." The corre-lation coefficients .between each variable and the 
principal component 'are provided for ease in labeling the component/. In , 



11 . / 

■■ < ■■ / ■ 

this way, eath subject group can be placed on the principal Acomponent by 
means of its contrast score. This feature of the MANOVA program provides, 
then, a descriptive example of how groups of subjects differ from each 
other in terms^of some multivariate dimension. * / 

In addition to j these multivariate features 6f the MANOVA program, 

» >. » ' / 

a lisr of the usual univariate F tests for each of tme variables is obtained, 

as Veil as the means associated with each of these/F tests. Ixi addition, 
the program also provides a within-cells correlat/ion matifix for the rela- 
tionship between each varicible and all other yaricibles. There are two 
important. reasons for using a multivariate statistical technique, such as . 
MANOVA when the researcher is examining data for differences among , subject 
responses which have been grouped in some', a priori way. First, it is singly 
more efficacious to eyamine differences which occur when many single vari- 
ables can be combined produce , one overall basis for discrimination. 
Second, because mamy variables are correlated or dependent upon each other 
in unknown ways, an analysis of each of them, .one at a, time, cannot control 
for the spurious effect. of this intercorrelation on emy series of single 
u)|ivariate F ratios^ the HAwOVA program provides, therefore, a way of 
examining the intercorrelation among the vari£±>ies to b^^ tested; judg 
can also l?e made about two separate significemt F tests of two different 
varicibles that* ane seen to/be thighly correlated^ This capaibility at least 
raises the question of whether to include both of the measures and to test 
them when one is seen as highly correlated with the other • 



3oci^-Emotional Scale Results 
The report^ of \Yie results will begin with a consideratyion of the 
first set of analyses and focus on the overall differences between handir 
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capped and nonhandicapped children, , between grade levels, and between the 
sexes. This will be followed by a rffport of the second set of analyses 
^ which focuses on differences withi^^ the group of handicapped chi;idren, with 
special attention g^ven to differences according to the type of special 
education program to^ which the children were differentially exposed. This 
section of ^ the report will then conclude with a discussion of these results. 

Analysis I 

It will be recalled that the design for the jfir?t set 'of analyses' 
was a 2 X 2 X 2 factorial where grade level, sex, and classification as 
handicapped or nonhandicapped were the design factors, and where *the 12 scale 
scores, fot;r each from the instniments Teacher Rating Scale, AboufcvYou and 
Your Friends , and Your School Days ,, ccxnprised the criterion variables. The 
results from the Autufim, 1973 and Spring,* 1974 scale administrations will be 
s^ported separately. ^ (In the following narrative, these two test administra- 
tions will be referred to as Autvmtn and Spring without reference to the years'.) 
.* 

Autijmn, 1973 . An inspection of -the withjin-cell correlation matrix 

' ' ' 

(not reported here) , which reports the relationships among all 16 criterion 

variables, warrants the decision to first examine the multivariate nature 

of thesevdata before examining the univariate results. The Correlation 

matrix indVrates a number of substantial correlations throughout the table. 

This is partr^ularly true for the four scales of the Teacher Rating Scale . 

Her^ ttie .first ^ale, Heeds Supervision, correlates -.500 with Scale 2, 

Misbehavior; .591 with Scale 3^, Outgoing, Expressive; and -.394 with Scale 4, 

Anxious. Depressed. Scale 2 (Misbehavior) shows no substantial correlations 

with 3 and 4, but Stale 3 (Outgoing, Expressive) correlates -.349 with Scale 

> 

4 (Anxious, Depressed). The inverse correlations might be expected on 



common sense grounds, but the positd<^e correlation ^between Scales 1 and 3 

suggests both scales are measuring somexhing redundantly similar. The 

second instrument, which ineasures tYCe studei^'s self-image, shows ^consider- 

aj^e overlap between Scales 1 (Loneliness, Rejection) and 4 (Misbehavior)^; 

i.e., r '= .660, and between Scales 2 (Enjoys School) ai^d 3 (Does well in 

School), i.e., r = .665. The t})ii:d instrument, Vour School Days , is a 

/ . 

measure of classroom cXimate in the student's view. Scale 1 (Enjoyment, 
Positive, Reinforcement) correlates .342 with Scale 3 (Cognit^ive* Emphasis) , 
and ,47,8" With Scale" 4 (Variety; Individualizatioi>)' . And, as might be ex- 
pected. Scales 3 and 4 correlate .414. • 

Notably, the scales from any one of -the three instruments dd^ not 
correlate 'highly with scales from any one of the other instruments, with 
oQe exception. There is a moderate correlation of '. 328 between Scale 2 
(Enjoys School) from AYYF and Scale 1 (Enjoyment, Positive Reinforcement) 
from YSD . The within-cells 'correlation analysis suggests tkat these three 
measures (teacher rating, student self-image, and classroom climat^)^ are 
sufficiently discrete from each other to credit "their differential inter- 
pretation when administered' to the same subjects. *It' suggests ^s well that 
witKin each of the instruments, considerable overlap among scales precludes 
treating any scale with high overlap as unidimensional and thereby moderated 
the interpretation, of significant univariate differences between subjects on 
.'the*- scale in question. 

* • In the reports of multivariate and univariate results which follow 
♦ • 

only significant effects will be included. In Analysis. 1 of the Autumn 
admitiistrdtion, there were no significant multivariate two-way or three- 
way interaclfion effects ^mong the three design factors. However, each of | 
the three design factors proved significant as main effects. Table^ 1 
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cpntains the results from the tests of the main effect of the^ grade level 
fagtor. 

In Table 1 it can be seen that the multivariate F = 13,621 is 

' " ( ' . * 

significant at beyond ,001, ii^^icating two points: the 12 scale scores 

provide a multivariate dimension on which students can be meaningfuj.ly 

di,%::rimihated according to grade level; and that one or Tnore of the 12 

scales will likely provide a univariate basis for discriminating between 

, grade levels. Figjf^e 4 illustrates the principal component (multivariate 
dimension) which discriminates students according to their placement in 
.grade level 1-3 or 4-6. An inspection of the list of coefficient's of this 
principal coil^nent (see Table 1, p. 14) suggests that it can be hiven 
tentative definition as "Positive : ^ Enjoyment, Positive Reinforcement; 
and Negative: Misbehavior," since these scale variahdes show the highest 

'correlation with the component; i.e., .616 and -.309. We can now ask* how 
the students, in terms of their grade level, differ on this principal com^ 
ponent'. * 'Phe contrast scores for each grade level 'group provide this infor- 
mation. The score for the grade level group 1-3 is -.561 and +.561 for 
the group at grade level 4-6 (see Figure 4) . Older students perceive 
their classroom climate significantly more, positively than do younger stu- 
deats^ Further ins^^ection of the coefficient list in Table 1 suggests' 
that the principal coitponent is also moderately determined by the inverse 
correlntion for Scale 8, Misbehavior, 1^6^7^.309. Thus, older students, 
also perceive themselves miv§bchaving l^ss often than do younger students. 
Univariate F test results will not be reported^here, but Table 1 reports 
that seven of the--F tests for these scales were significant. In the 
analysis, it will be seen later that while this particular component gets 

V 

v^relab^ed,- it is still the effect of perceived classroom climate that again 

* 

/ < 
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FIG, 4. Principal Comppnent Associated With Main Effect.^ of Gx;ade ^Level 
Factor for Analysis 1, Autumn,^ 1973 
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provides discrimination between grade levels. , 

^ The results of the effects associated with th& sex.fact'or are 
reported in Table 2, which indicates a significant multivariate F of 7.572 
for the effect of the sex factor. This ^J.tivariate t for sex carries, with 
it five significant univariate F ratios as well, indiq^ting numerous ways 
ia which to discriminate among students according to sex. The most effi- 
cient way to describe these differences is provided by th^ principal com- 
ponent of the hypothesis of sex. ^Inspection of the list of coefficients 
in T^ble 2 indicates that a dijnension labeled "Negative: Misbehavior" 



mi 



i^t bfe affixedv^ this component. The component is illustrated in Figure 

[ . . The correlation coefficients for Scales 2 (Teacher-Rated Misbe- 
havior) and '8 (Self-Rated Misbehavior) provi<^e the definition of the com- 
ponent.* A contrast s6ore of +.477 for boys and -.477 for girls sug^sts 
that teachers rate boys as more misbehaving and boys perceive themselves as 
more misbehaving in their classes than girls. These differences according 
to sex will be seen to disappear on analysis of the Spring results. 

Table 3 includes the results for Analysis of the effects associated 
with the design factor of handicapped-nonhandicapped. ' As one might expect, • 
the itiost significant effects are associated with this factor compared with 
grade level and sex (see Tables 1 and 2). As a me^ns of grouping students^ ^ 
the classification factor differentiates between them more strongly thm 
tlxe other two factors. Inspection of* Table 3 indicates a multivariate 
F =^6.891, p < .001 for the ^handicapped-nonhandicapped classification 
factor; moreover it shows that the teacher ratings (Scales 1, 3, and 
4) comprise the largest univariate F ratios for all '12 of the scales. Even 
• SO, the univari^ate F ratio for scale Variable 5 (Loneliness, Rejection)- 

■ ■ ' 24.- - : • • , 
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FIG. 5. Principal Component Associated; with >fain. Effect of Sex Factor 

fbr Analysis 1, Autumn, 1973 



2G 



20 



0) 

u 

c 

0) 

C 
•H 

o 
u 

c 

U) 

c 

o 
a 

§ 



c 

00 

CO 

o 



c 
o 

cd 
o 



cd 

> 



C 

c 

o w 

0- C 

O QJ' 

y 

Cd ^ 
CO 



a\Cr>vo<rC^OiHiHOfHiHO 



I 



I I I 



I I 1 





















O 


















Cd ; 


















.to 


u 








•H 


o 








U 


00 








cd 


00 








> 


< 


















































f 










■» 














» 














r>. 












r 








iH 








« 
































u 




















< 


















r 







CO 
03 

■ Cd 
c 



c 



, o 
in 

CM 



00 

>% 

Q) 

Cd 

cd. 
> 



00 



c 

cd 



00 
03 
0) 



MHf-irHi-iirjirivo'aNcncMiri 
OOOOOCNliHOiHcn^TO 
00000<riHQC400CM 



sp- 
in 



<T.f^rnrHiH00CfrniA\OvOiH 

vooc^ONi-HcnakONi-ivovOiH 
OiHOCinvo^rvommiH^d" 



r>. o c>i ON H* <N r>. 
r>. <Nj tx) rH * . 



iH <r <r iH 



c 
o 

CO 




> 

u u 

0) o 
a 

o > 

w cd 

CO 



c 

o 

0) o 
CO 0) 
00 T-j 
0) 0) 



CO 
CO 

a a 

^ 00 

6C 0) 

C 0) C 

O O fH 

^ _ eC-H 0) 

O ' CO X C 

"•,0? ^ a c o 

SJ'S O < ^4 



o 
o 

o 
w 

c 

M 



U4 

c 

0) 

> 



J-l ■ 

o 



o 



o 
o 

CO iH 
Q) 

CO :^ 

O CO 

c o 



o 

> 

cd 

Q) 
CO 



4Jl 

Cd, • 

> N 

cd •H 

0) 00 Cd 

CO 00 'O 
•H td.-H 

:2 •>. 
a-rf 

CO u c 
CO M 

c > 

a ;P 4J 
cd C "H 

c o cd^ 

D O > 



• • • • 

iH c>4 m 



vO 00 ON O iH CNJ 



ERIC 



27 



/ - 



ERIC 



it • • . 

provides good discrindnation; this is notable because this is a self-image, 

a' 

measure to which the Students responded. *In amy case, for now the, multi-r 

• *^ 

Variate dimensdon ^® described fallowed by, a report of certain of .the 
univariate F rations and their ' corresponding me^'ns. 

Figure 6 illustrates the bi-polar principal component, of ^the 
Classification hypothesis* ' U^ing the list of coefficients from table 3 . 

- .r^"-^^ ■ . . . ' - • 

to Ictbel this bi-polar component, one might select scale variabres^ 1, 3J 
and 4 auid label the , component "Bositive : Needs Supervision, Outgoing; 
Negative: Anxious^ Depressed." The component discriminates between 
handicapped children who are seen .to be rat^d by their teachers as needing 

more supervision in class, as being jnore outgoing, butT^as being less anxi6us 

' *' ' ' ^ > 

than are nonhandicapped of norraa2? .school children. The m^ans associated 

. ' • - , ' * 

with * the* significant t^nivariat^^ F rataos for -Scales 1, 3 and 4 tsee 

^able 3, .p^ 201 ' leave ^ut these interpretations and^ provide further detail.. 

Tabic 4 coHua^ins .the means for Tiandi capped and nonhaiidicapped stud6nts/bn 

the scale vari^les afr 1) Needs Supervision; 3)^ Outgoing, Expressive; and 

4) Anxious, Depressed. T^ie analysis of these same data at the Spri.ng" 

administration will sbow'.sqfoe interes'ting cHange^ over time when scores 

from the prior analysis aire included to allow for initial difTe^ences '^ong 

handics^^ped and nonhandicapped students. 
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FIG. 6. Principal Component; Associated with Main Effect of Class- 
ification Factor for Analysis 1, 'Autumn, 1973 
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Table 4 ^ 
Analysis 1 Autumn, • 1973: Selected Means for Handi^J^d and Nonhandicapped 

Students from Scales 1, 3, and 4 , 



Scale 1: Needs Super'/ision 

Scale 3: Outgoing^ 
Expressive 

Scale 4:* Anxious.*, Depressed 



Handicapped 

131.19 
18.81 

^ 

16.91 



Nonhandicapped 

94.73 
14.73 

19.09 ' 



* Spring,' 1974. Th,e design far the first analysis of the Spring 

data is identical with that for the Autumn analysis (see Figure 1, p. 5) 

with one major' exception. The latter ap^lysis included all scores from 

Autumn as covariates. In this way, differences from the prioj: analysis 

were equated so that any differences ^ich would emerge for the Spring 

analysis could be seen as independent of these earlier effe^s. This per- 

mits holding these earlier differences constant to determine whether cuid 

how differences at the second analysis are now related to the factors of 

classification, grade level, and sex. 

The results of the Wi thin-cells corf elation .analyses are sub- 

stantially the same as they were in the Autumn analysis. The only notable 

differences in the pattern of intercorrelations among the 12 scale variables 

/ 

is that the four scales from the Teacher -Rating Scale are now less highly 
related. Where before variable 1 (Needs Supervision) was highly -related 
to the other three scales, it now Prelates only with variable 3 (Outgoing, 



• Expressive )/^t r = .6§2. 

An this Spring analysis, none of the interaction effects among 
desi^ factors nor. the sex factor were significant -as a way of discriminat- 
i.'dq between student responses (F^^^ = 1.654, df = 12/489, p < .074). It 
will be recalled that boys ha^ been clearly discriminated from girls on 
the basis of teacher ratings of boys' greater misbehavior and boys* own 
perceptions of more misbehavior in their classes than girls. 

However, grade level and classification as handicapped or non- 
handicapped did remain as significant ways for differentiating among these 
students. The multivariate F for the, grade level factor was F '= 4.853, 
p < .001. These results are reported in Table 5 where the reader can thep 
compare them with the earlier results for this same factor at Autumn 
'(see Table 1, p. 14). Fewer of the scale variables are significant this 
time as variables 1, 8, 9 ajid 10 drop out, and variable 2 (teacher-rated- 
Misbehavior) iff picked up as significant. This changes the principal com- 
ponent on which students are to now be differentiated. Before '(see Figure 
4, p, 16), the component was "Enjoyment, Positive Reinforcement," indicating* 
that discrimination was primarily provided by that portion of perceived 
classroom climate dealing with this variable , ^ number 9. Now, digcrimination 
is seen to consist of a negat^e (dimension that — using variables 2, 11 and 
4 from a li^of coefficients in Figure 7 — might be labeled "Negative: 
Co^rfrf?Sir*'^Bia^asis, teach.errrat^ Misbehavior, Anxious." Thus, children 
in grades 1-3 perceive less cognitive emphasis in their classes and dre . 
rated by their teachers as more misbehaving than children in grades 4-6.* 
Previous differences according to a perceived enjoyable classroom climate 
are* now eclipsed by ^egative tether ratings of younger students and by 

■ ■ 31 : . , 
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their own perceptions about classroom cognitive emphasis. Clearly theh, 
differences between grades at the earlier analysis do not predict the nature 
of subsequent differences between them. 

Differences between handicapped and nonhandicapped students still re- 
main for the Spring analysis but there are considerably fewfer of th^m. 
These results are reported in Table 6 where the F foi} the oj^ssif ication 
factor is 2.029. In the analysis for Autumn (see Table 3), there were eight 

/signif icanj: differences to be -examined. Here, there ate only threj§^ which 
remain as significant, ^i. e. , Needs Supervision; Loneliness, Rejection; and 
Variety, Individualization. Using variables 1,^5 and 12 from the list of 
coefficients from Table 6 suggests that the discriminating principal com- , 
ponent can be given tentative definition as "Negative: Perceived variety; 
and Positive: Needs Supervisiony.jNegative : Loneliness, Rejection" (see 
Figure 7). In other words, each of the three instrumerrts enter into the 
discrimination between handicapped and nonhandicapped students. The 
principal component is given in Figure 8 wliere it can be seen that maximum 
discrimination for the classification factor is best provided by a multi- 

' variate (dimension whose properties are the differentially negative and 
positive response^ about these students. This means the character of multi- 
variate differences is a factor dominated primarily by the contribution of 
scores from scale variables 1, 5 and 12. Table 7'cohtains the iheans' asso- 
ciated with the variables. As in the previous analysis, handicapped students 
are still rated by their teachers as heeding^ more supervision thaa non- 
handicapped students. Apparently, the teacher still finds these former 
students less academically involved. .Interestingly, however, the non- 

handicapped studerits "perceive themsej.ves as more Ignely and rejected than do 

. ** ' * < » 

handicapped students. Lpneiiness and rej'&s^idn, as a measure of self-image, 
•. • ' 
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FIG\ 8. Principal Component Associated with ^^ain Effect of Class- 
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'retains the power to differentiate at ♦the Spring measurement, but now Qon- 
tributes more heavily to the determination qf the multivariate^ nature of the 



differences between these two groups. The mean difference between the two 
groups on the perceived climate of va'riety and . individualization, while 

• ■ " i ' ■'■ ■ ■ .: 

statistically significant, would seem '^o be of^ little educational ^significance. 



Table 7 ' 

.Analysis 1 , Spring 19 74 : Means 'for Handicapped and Nonhandicapped 

Students from Sc^le 1, 5 and 12 

> Hatidficapped Nbnhandicapped 

Scale 1: Needg Supervision 128-18 ' 98.69 

Scale 5: Loneliness, Rejection y ^ 29.15 31.41 

Scale 12: Variety/Individualization 11.09 ^ 11.14 



In summary r it can be stated that when the dif ferences^etween handi- 
capped amd nonhandrcapped studei)ts which occur irrthe analysis of Autuion 
data are controlled f9r in the- analysis of Spring data, there are no longer 
any differencSfe between these groups with regard to teacher-rated misbehavior, 
outgoingness, anxiety, the student's gelf-attribution of loneliness'* and mis- 
behavior, or his perception of the '(ilassrdom climate as^characterized by 
unhappiness and a cognitive emphasis. This is not to say that thes6 differ- 



7 ■ • - 
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ences do not exist at the S^rin^' Measurement period. Rather^ it is just tJ^at 
they, are no longer ef f^tive^ ways of distinguishing or^ characterizing 
handicapped and no nhandi capped stuc^it^s. In one sense / these two groups 
become similar over time, and in terms of teacher ratings, more favorably 

9 

SO fSir handicapped students. Evidently, handicapped students 

also, like their counterparts', are not different in the way they attribute 

misbehavior to themselves, and again, like their nonhandicapped peers, are 

not different in how much unhappiness^ and misbehavior they perceive as 

* characteristic of their classroom climate. Where they remain different from 

nonhandicapped students over time resides in how their teachers rate them as 

again needing significantly more supervision than their more normal peers. 
» 

Analysis 2 

o 

The^second set of cinalyses of data at the two points in time con- 
cern handicapped student^ only. The design factors were, again, grade 
level, and sex and the addition of a program factor representing the type 
of special education program to which the student was exposed (see Figure 
2, p% 6), i.e^, 1) traditional resource room, 2) resource room/stratistician- 
generalist mixture, 3), stratistician only and 4)^contrast ^schools (no RMRRC 
program involvement) . Tli^ variables used were identical to those included 
in tlie first set of analyses, i.e.,' the 12 scale varaUbles. 

"J 

Autumn,. 1973 . The within-cells correlation matrix for the analysis 
of the Autumn data repeats the pattern for the pfevioutB analysis comparing 
handipapped and nonhandicapped students. As before/ the teachers' rating 
of variable 1 (Ne^ds Supervision) shows the highest intercorrelations with 

^ * * " * o 

the three other variables in the •Teacher Rating Scale, i.e., r = -.468; 

1,2 

^ • 

r, ' = .538; and r, ^ - -'.^54. As well, handicapped students' responses on 
1/3 1/4 1 



1 
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their perception/of their Loneliness (5) and the^^gown Misbehavior (8) 
correlate .726, as do their responses for Enjoys Scho4)l (6) and Does Weil 
in School (7) -7 = .702.' Finally scores on Enjt»yment, Positive Reinforce- 
ment (9) and Variety, Individualization (12) porrelate .417. 

. ' Inspection of the MANOVA results indicated that the three-way multi- 
variate interaction effect among program, sex and grade level was not signi- 
ficant (F = 1.251, p < .150), ^hor were the two-way multivariate 'interactions 
between sex and grade level (F = '.558, p < .875), ot between program and sex 
(F = 1.310, p < .107). The two-way multivariate j nteraction, between program 
and grade, however, was significant (F = 1.638, p < .jOll) . ^ These results 
are reported in Table 8 where it can be seen that significant univariate 
differences occur on scale variables 5, 7, and 10. The principal component 
associated with this interaction effect seems best described as a combina- 
tion of "Dcfes Well in School/Loneliness, RejectionV (see Figure 9) . The 
component provides maximum discrimination between stude^s at grades 4-6 
in the resource rpom/stratistician prcJgram type who are likely to say they 
are doing less well^ in school but are also less lonely or rejected, and those 
stifdents alsa in this same program type but at grades 1-3, who are more 
likely to say i?hey are doing better in school but are lonelier and feel more 
rejected. Clarification of these differences is provided by (Table 9 where 

the means for ^ach of the eight groups constituted by the interaction effect 

t 

\ . > ♦ V 

are reported.' ,There, maximum univariate differences' are found between 
older handicapped students in the resource room/stratistician pj^gr^m type 
who perceive themselves as lea^t lonely and students in the/cpntrast schools 
category as irost lonely. On the principal component (see Figure 9) Lone- 
liness,^ Rejection will be seen 'to occur again as a means of discrimination 
fox;^the *same interaction at the Spring analysis. 
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+ .7 - ■ 
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+ .5 
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Grade Level 
vGj^^^Tades 1-3 
G2=grades 

' Program. Iyp£|^ 
P2^= Traditional Resource Room 

P2= Resource ftoom/St.rat,istician 

P3= Stratistician only . 

P4= Contrast Schools 



r +.1 
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FIG. 9. Principal -Coni^Jjfeent Associated with Interaction Between Program 
and Grade foi^^alysis 2, Autunui, 1973 
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Tab^e 9 



/ 



Analysis 2, Autumn 1973: Means for Progratn and Grade -Interaction on Loneliness, 
Rejection (5); Does Well in School (7); and Unhappiness, %sbehavior (la) 



Srogram/Grade 


/ C N 

(5) 

Loneliness, Rejection 


(7) 

Does Well in School 
— ■' 


"(10) 
UnRappiness 

J-'isbehavior 




-29.69 


28 . 2*9 


21.40 




30.19 


. 31.43 


• 22.65 




30.12/- 


27.83 • 


21.28 




25.60 


• 26'46 


21.50 


P3G, 


• 29.39 


^ 26.91 ■ . 


21.44 


P3G2 


27.97 


31 . 70 " \ 


•22.00 




29.90 


26.77 


22.65 




N^^^ 30.60 ;v 


31'.19 


22'. 20 



Program Type ^ Grade Level 

?-^= Resource Room Onlv 
?2= Resource Rootn/Stratistician 
P3= Stratistician Only 

P = Cont-rast Schools (no RI^fRRC involvement). 



Gi=l-3 
G2=4-6 
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» * 

When differences among handicapped students are examined in terms of 

grade level, the multivariate F is significant (i.e., F =,8,603^. p < ,001), 

"and in .the same ways as were true for grade differences when handicapped 
J 

students were compared with nonhandicapped students in Analysis 1 (see Table 
^ 1,^^. 14), • Table 10 contains these results for handicapped students. The 
principal component appears to be a dimension that can be given tentative 
c^finition as "Positive: Enjoyment, Reinforcement; Negative: * Perceived Mis- 
behavior." Figure 10 illustrates the principal cor^ponent, and i't is identic 
Kii^l with the component identified with grade level differences in Analysis 1, 
I rrt Figure 4. Again, older students perceive more enjoyment and positive 
1 reinforcement in fehetr classroom climate and see themselves misbehaving less 
than the younger handicapped students • ^ * 

In the same w^y that the sex factor^ discriminated between the sexes 
Analysis 1 at Autumn, it does so again, for handicapped students considered 
by themselves. These results will not be reported in detail here except to 
point^out that the multivariate F = 2.879 p "< .001, ^d that, again, the 
first two score variables of the teacher rating scale contribute most to the 
discrimination^ As before, teachers rate boys as needing more supervision 
and as misbehaving more than girls. These differences according to both 
sex and grade level duplicate the results in Analysis 1 at Autumn, and point 
out that, at least for teachers, the differences are minimal between handi- 
capped and nonhandicapped students in terms of age^-related factory and for 
the students themselves in terms of when grade is the factor on which to 
examine diff erenc^es. 

In the A\2tumn, there were a conskierable number of significant dif- 
ferences among handicapped students according to ^the type of special educa- 
tion program design factor .(i.e., F = 2.094, df = 36/931. A3, p < .001). 
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FIG. 10. Principal Component Associated -wit-h Main Effect of Grade 
Level for Analysis 2, Autumn, 1973 
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Here the multivariate dimension or principal component emerged primarily 
from the pattern of differences on the scales 'conceiming perceived classroom 
climate. . These results- are reported in Table 11. The principal com|)onent ^ 
which provides the maximum discrimination among the four special education 
program groupings would appear to''be a factor clalled "Negative: Perceived 
Classroom Cognitive Emphasis, and Variety." This component is illustrated 
in Figure II, where it can be seen that children in the contrast schools 
perceive significantly less cognitive emphasi^and variety, and where 
.children exposed to the stratistician-only program perceive the most of 
these two clas^oom climate features. 

V- 

Spring, 1974 . When the Autumn scores for these handicapped students 
are included as covariates in the analysis of results for the Spring, the 
number of sizeable correlations .among the 12 score variables decrease .from 
eight to four^ Ovferall, the program and grade interaction effect and the 
main effects of grade level and sex remain as factors which discriminate 
among these handicapped children. The program and sex interaction effect 

now enters as a significant means for discrimination, and the multivariate 

/ 

ejffect of program type drops out 'as a source of difference. However, there 
is a significant univariate effect of program type associated with* scale 
variable 6, Enjoys School. 

For the program .type and grade level interaction (F = 1.672, df = 
36/895.98, p < .008), a bi-polar dimension called "Negative; Perceived 
Cognitive Emphasis; Positive : ^ Loneliness and Rejection" provides some mini- 
mal discrimination here. Even though the multivariate effects are significant 
in this interaction, the univ^jciate F tests for each of the 12 scale variables 
failed to reach significance. In short, there are now far fewer differences 
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Negative: Perceived Classroom 
Cognitive Emphasis and Variety^ 



+.7 
+.6 
+.5 
+.4 
+.3 
+.2 
+.1 
0 

r.l 
-.2 
-.3 
-.4 
-.5 
-."6- 
-.7 



*+.616 (contrast schools) 



•+.113\(?.es.^oori/^S6fatistician) 



*-,318 (Resource Room) 
•-•411 (Stratistician) 



FIG. 11. '^Principal Component Associated with Effect of Program' 
Type for Analysis ^, Autuitm, 1973 . ' 



ng handicapped chiidren which- are associated with the combined effects of 
pto'g^ and grade when viewed over time. Whatever differences did discrim- 
inate in the previous Autumn in terms of ^the program and grade interaction 
are' not sizeablq enough in the following spring tp substantiate a program- 
grade combination as a meaningful way to' describe differences. Fo^ these 
reasons, neither tables , nor figures associated with the tests of this inter- 
action effect will be reported here. 

The multivariate interaction between program type and sex does rea<:h 
significance (i.e., F = 1.75?, df .= -36/895.98, p < .004)*at the Spring ad- 
ministration. It will be recalled that this particular interaction effect 
was not significant during th?^ preceding Autumn. When those Autumn scores 
are inclu'ded in the Spring analysis, pne difference occurs among the 12 
scale scare, variables; this difference' is located on scale variable 12, 
Variety, Individualization (i.e., univariate F = 2.972, df = 3/314, p < .032). 
I^is doubtful that a statistically signifi^cant difference among the means 
Vfo^; tfhe program type and sex combination amounts to an educationally signi- 
ficant difference in" any case. ' . 

Again, grade level remains a powerful way to discriminate among 
handicapped children when Spring data are analyzed (F == 3.32l', df = 12/303, 
p < .001), and particularly in terms of teacher ratings of student Misbehavior 
^and Anxiety, Depression, and in terms of student perceptions of classroom 
Unhappiness, Misbehavior and* Cognitive Emphasis. In the previous Autumn, 
grdde-level differences had been' associated with teacher ratings of Anxiety, 
Depression and with student ^self-evaluations of Loneliness, Does Well in 
School, Misbehavior and perceived Classroom Climate regarding enjoyment. 
The results of differences associated with grade level during the Spring 
were reported in Table 12. The principal component whi'bh now discriminates 
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between these two grade levels might best be Icibeled "Negative: -Perceived 
Cognitive Emphasis and Anxious, Depressed." This component is illustrated 
in Figure 12, where it can be seen that children in the lower, grades per- 
ceive more cognitfve emphasis than those in grades 4-6, arid are rated by 
their teachers as more anxious and depressed than are those in grades 
4-6. It is also to be noted that teachers rate handicapped students in the 
lower grades (1-3) as significantly more misbehaving (i.e., mean rating = 
1-?3.13) than they rate students in grades 4-6 (i.e., mean rating = 117.80). 
As well, older handicapped students (grades 4-6) perceive more unhappiness 
and misbehavior jas characteristic of their classrooms (i.e., mean = 22.38) 
than do the -yotinger students (i.e., mean = 21.66). 

Classification by sex also remains as a significant factdr for 
distinguishing these handicapped, although siich differences are far fewer 
and less significant in the Spring analysis (i.e., F = 1.852, df = 12/303, 
p < .04). In fact there are no significant univariate differences now to^ 
be found on any of the 12 scale variables when examined individually, so 
these data are not reported here. The principal component which does pro- 
vide ^pme discrimination is characterized by the highest weight being 
associated with scale variable 6, Enjoys School (r = .393). In this case, 
it is the handicapped boys who indicate they enjoy school '(mean = 38.60) 
more than do the handicapped girls (mean = 36.45). 

When the main effect of the program type is tested for the Spring " 

♦ 

administration, the multivariate F is not found'to be significant (i.e., 
F = 1»287, df = 36/895.975, p'< .122), althougH the univariate F Associated 
with scale variable 6, Enjoys School, , is significant (i.eVv^univamat 

F = 2.960, df = 3/314, p'< .033). Apparently.it is these handicappeST'stu- 

/ ^ ' ' . ' 

dents associated with the stratistician-only program (^.e.^, 'mean = 38.73) 
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Negative: Perceived Cognitive 
Emphasis and Anxious', Depressed 



+.7 
+.6 
+.5 
+.4 
+.3 
+.2 
+.1 
0 

-.1 
-.2 
-.3 
-.4 
-.5 
-.6 
-.7- 



•+.380 (Grade 4-6) 



•-.380 (Grades 1-3) 



FIG. 12. Principal Component Associated With Main Effect of Grade Level 
^ . for Analysis 2, Spring, 1974 

9 



wh* report enjoying school more than the students in the three remaining 
program types; i.e., traditiojial resourcfe room, mean = 37*16; resource 
room/st:ratistician combination, mean = 36,75; and contrast schools, mean 
=^ 37.47). 

As was, the case 'when handicapped and nonhandiOapped students were 

both included in the same sets of ^nalysesTlian3?<;a^ only 

exhibit fewer, differences in the Spring when compared with the Autumn 
♦ - • » * 

analysis. The effects of th^^^^pecial education program factor do remain* 
as a significant area of describing differences among stud<^nts on theses^ 
social-emotional variables\if the interacting effects of both the student 
age and sex are taken into account. The point to be made here is that 
generally where differences are found at the' Spring, they are a new set 
of differences when compared with how students were different from each 
other in the previous Autumn. One consistent difference trend does occur 
wh^n the effects of program are examined. This trend relates to the way 
in which differences regarding student self-evaldations of their sense of 
loneliness and rejectiofy and their perceptions/ of ^laasroom cognitive 
emphasis (as associated with program type anj^/or program and grade in the 
Aurumn) are still found as variables which oiscriminate among them during 
Spring. 

Academic Achievement Test: Results 
Usitig the same design factors included in the analysis of the 12 



scale variables above, two additional sets of analyses were run on the 
results of student grade equivalent scores from the Metropolitan Achieve- 
ment Test . Specifically, fo^r scores were obtained and these were folr: » 
1) Word Knowledge, 2) Reading, 3) Tofeal Reading, and 4) Total Math. 
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» 

Analysis 1 ■ ^ 

Autumn, 1973 > The first set of analys,es examined the grade equivalent 

scores of both handicapped and nonhandi capped students in the Autumn and 

again in the Spring, With the Autumn serie^>ncluded as covaria1^e3>^s a 

reminder, the design factors here were 1: classification as handicapped ^ 

(N = 314) or nonhandi capped (N = 1,454); 2: ' sex^(M = 919, F = 849); and 

3: grade l^vel (1-3 = 744; 4-6 = 1,024). 

As might be expected, the within-cells correlation mati;ix (not 

reported here) reveals 'that all four' scores are highly interrelated, parti- 

cularly the first three verbal measures; (i.e., r, « = .824, r = .950/ 

1,2 1/3 

^1,4 ^2,3 ^2,4 ^-5 4^ -708). The three-w^y inter- 

action among t:he design factors^ was not si^gnificant (F = .241, d£ = 4/1,741, 
p <..915), nor was the two-way interaction between sex and grade l.evel 
(F = 2.059, df f 4/1,741, p < .084). However, the interaction between the 
handicapped factor and grade level was significant in the Autumn (i.e.,. 
F = 6.434, df =.^1,741, p < .001). Table 13 reports the-results for the 
interaction, ' 
/ l*he multivariate dimension seems b^^ described as a "Reading or 

Verbal" component, where handicapped students at both grade levels 1-3 and 
4-6 are maximally different from nonhandicapped students at both grade 
levels. As an illustration of these differences, the means^for the Reading- 
scores of the groups coniprised by this interaction are reported in Table 14.. 

The next higher order effect, that between handrca£>ped status and 
sex, was not significant (F = .379, df = 4/1,741, *p < ..824). The multi- 
variate main effect for handicapped status was si^ificant (i.e., F = 55.722, 
df = 4/1,741, p < .001) as wa*S that for the'^main effect of grade level (i.e., 

54 . ' 



Table 13 



Analysis 1, Autumn, 1973: Multivariate a^ Univariate Results and Principal 
Coinponent Coefficients for Achievement Test Scores Associated with Effects 
of Handicapped Status/Grade Level Interaction 



Multivariate Analysis 
F 

'« 6.434 > 



df . 

4/1^751 



Univariate Arialysis 
Variable 

1. Word Knowledge 

2. Reading - 

3. Total Reading 
A. Total Math. 



F(dfX/1^744> 



18.936 
25.118 
24.027 
16.294 



Table 14 



less than 

.001 
.001 
• .001 
■ *.001 




Principal 'Component 
Coefficients 

.857 
.987 
.9^5 
.795 



Analysis '1,' Autumn, -1973:' Readin^g Score Means Associated with Interaction 
Between Handicapped Status and Grade Level .Factors 



V 



Handicapped 



Nonhandicapped 




Grades 4-6.. 
4.473 
5.700'* 



J 



49 

F = 386.641, df = 4/1/741, p < .001). However^ because -each of thdse factors 
was involved in their previtjusly reported interaction/ a straightforward 
interpretation of each' is ^ot possible, particularly since each of four vari- 
ables was also significant at £he unj.variate level under .the two-way multi- 
variate interactions • Hence, grade level and handicapped status do provide 
discrimination among students at the Autumn analysis / but a consideration of 
one of these factors*must include the-^ther when th^. scores on all four 
v^iables are Examined. ' , * . 



Table 15 ' * 

Analysis* 1, Autumn, 1973: Multivariate and Univariate* Results and 
Principal Component * Coefficients Associated With Effects pf Sex Factor 



Multivariate Analysis ^ *^ ^ 

P 

df less than 

4 . 234 ' 4/1,741 .^002 

! - r -T , 



Univariate Analysis 



p i. Principal Component 



Variable • F(df*l/1,744) le3s than Coefficients 

1. Word Knowledge 3.412 .065 . ,448 

*2. Reading 8.497 ' .004 ^ ,708 

3. Total Reading 5.895 .015 . .589 

4. , Total Math ^ .000 .983 .005 
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It can^e reported that the sex factor was significant (i.e., 
^ ^ 4.234, df j= 4/1^741, p < .002) for finding differences among males 3nd • 
females on their achievement test scores. These results are reported in 
Table 15. above. There, it can be seen that it is the univariate F's for 
Readiiyg and Total Reading which provide the difference between the sex^s 

s 

and the definition for^^e principal coroponeht. The means 'for Reading 

and Total Reading are reported in Table 16 below ,^ and the girls are s^en to 

be reading at a higher level than, the boys. 



Table 16 



** Analysis 1, Autumn, 1973: Grade Equivalent Means for Main Effect of 

Sex Factor 



Hales 
Females 



Reading 

3.7« 
' 3.871 



' Total Reading 

, 3.791 
^3.896 



Spring > 1974 * Our interest .in examining these grade equivalent 
achievement scores in the Spring resides in determining whether differences 
foiind in the Autumn will still be seen to occur. Another way of asking 
;this question is to phrase it thus: will any differences among students 
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t)7 



- 51 

xn the amount of their gains in grade equivalent scores between Autumn and 
Spring be associated with the design factors which were signifigant. in the 
Autumn? The answer to this question is a partial yes. No interaction 
effects are now found to be significant^ including, the interaction between^ 
handicapped status and grade level (i.e., F = .733, df = 4/1,737, p < .570), 
tfowever, both the main effects o% hcindicapped ^tatus and grade level" remain 
significant and their interpretation is now more straightforward. The main 
effect results for the grade level factor are reported in Table 17 whete 
it can be seen that none of the univariate F tests reached signifp-cance . 



Table 17 

Analysis 1, Autumn/ 1973: Main Effect Results For The Grade Level F.actor 



Multivariate Analysis 

F df less^than 

3.006 4/1,737 ^ .Oir 



Univariate Analysis 



Variable k ' n Principal Componer 

F(df=l/ 1,740) lessPthan Coefficients 

1. Work Knowledge* 1,258 .262 .323 ^ 

2. Reading * .681 - . .409 - -.238 

3. Total Reading .281 ' ,596 -.153 

4. Total Math 2.609 ,106 -.465 
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The' principal cdrnponent which discriminates younger from 6ider students is 
clearly Total Math, and it is also clear that older students are reaching 
? greater ^gains in grade equiv^^^^scores than younger students, ^particularly 
^in terms of mathematics achievement. 

The main, effect for the handicapped status factor was also signifi- 
,cant (F = 4.189, df = 4/1,737, p < ,002) and these results can be found in 
Table 18 below. The grade equivalent means'for each of the four variables 

De found in Table 19. There it can be sefen that, the handicapped stu- 
dents are somewhar more than one full average grades-level below the non- 
handicapped students on these four measures of academic achievement in the 
^Spring. As well, in no case do the handicapped students gain a score 
level at the Spring which is equivalent to the scores of nonhandicapped 
students the preceding Autumn. • In other words, even with Autumn scores 
used as covariates to equate for initial differences on the variables in 
the Spring analysis, nonhandicapped students still qremai^n^^^full grade- 
level equivalent ahead of their handicapped peers. In any qase,' the^ fact^ij-^ 
that there are these dif ferences' in the Spring analyses is not due to the / 
way in which these students scored in the Autumn. The differential effects 
of handicapped status on these measures og^^ac^emic" achievement are not 




attenuated by the passage of tijne .spent ±n school from Autumn to Spring. 
It is to be noted, however, , that the handicapped students do make consider- 
able achievement 'gains of approximately one-half year grade-level equivalents 
b'etwe.en these two points in time, and that the absolute ambunt of their 
gain, is comparable to that of the nonhandicapped students. 
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Table 18 



Analysis 1, Spring 1974: Multivariate and Univariate Results and Principal 
Coinponent Coefficients For The Main Effect Of Handicapped Status Factor 



Multivariate Analysis 

■> 

F 

4.18? 



df 



less'^than 
,002 



dnlvariate Analysis \ 

Variable F(df=l/1740) 



less than 



Principal Component 
Coef flci^ts 



1. Word Knowledge 9.482 

2. • Reading 8.027 

3. Total Reading 10.877 

4. - Total Math. 7.810 



.002 
.005 
.001 
.005 



» « 



.752 
.692 
.805 
.£82 



Table 19 * 

Analysis 1, Spring, 1974: Comparison x)f Grade Equivalent Means Associated 
With Main Effect of the Handicapped Status Factor for Autumn and Spring 





Word Knowledge 


Reading 


Total Reading 


Total Math. 

I, 




Autumn 


Spring 


Autiinm 


Spring ' 


Autumn 


Spring 


Autumn 


Spring 


Handicapped 


(3.366) 


3-719 


(3.195) 


3.552 


(3.252) 


3.593 


(3.163) 


3.605' 


Nonhandicapped 

r 


(4.518) • 




(4.419) 


4.907 ' 


(4.436) 


4.843 


(4.004) 


4.659 ■ 
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Autumn f 1%73 , Wherr the achievement test scores of handicapped 
students alone are aoSiyzed fpr the Autumn, differences can be, found* 
associated primarily with an interaction between the design factors of 
, program type and grade level and with the sex design factor. Ther^ are ' 
also in^in effects for grade level and program type alone but because these 
are bound up in a two-way interaction effect, only those variables not, 
involved in the higher order interaction will t>e interpreted. 

• The multivariate F for the program type/grade level interaction 

/ 

(F ~ 1.972^ df = 8/598, p < .048)- was accompanied by significant univariate' 
F's fujL Dotii Reading and Total Math (^^^g^^^ij^g = 3.323, df = 2/302, p <'*.037; 
^Total Math* ^ 3.276, df = 2/302, p < .039). ^he principal component can be ' 
defined as "Total Math and Reading," with the students in the stratistician 
program type being inaximally different from students in the other twp pro- • 
grams included in this analysis. That -is, for example, grade 1-3 students 
associated with the stratistician program have the highest Reading scores 
as seen in Table 20 below. As well, the st^ratistician, program students 
at grade level 4-^ have the lowest Reading score mean; and again, the same 
Arade level students in the stratistician progr^ have the lowest Total 
VMath mean score for grades 4-6. Hence, the effect of program is ,due 
largely to the stratistician type in combination with the student's grade 
level for scores 6n Reading and Total Math. \ 

There were no other significant higher order effects in this Autumn 
analysis. The multivariate main effect of gr^de was significant (F = 56.102, 
^ df = 4/299.r p < .001), but since it interacted with the ^program factor only, 
those variables not significant in that interaction will be discussed here. 



7 



Table 20 

Analysis 2, Autumn, 1973: Grade Equivalent Means Associated With The 
, Program And Grade Level Interaction ^ 



Program: 


Resburce 


Room 


Resource Room/Strat. 


Stratistician 


Grades : 


1-3 


4-6 


1-3. 


4-6 

• 


1-3 


4-6 


Reading 


2.413 


4.071 


2.328 


4.331 


2.510 


3.519 


Total 














Math. * 


2.559 


4.189 


2.236 


4.186 


2.30* 


3.511 



f 



Table 21 reports these results. 

These differences are of course self-explanatory in that grade* 
4-6 students score significantly higher than do grade 1-3 students, and 
the overall difference is best represented by a principal component dom- 
inated by Total Math. 

'3' 

The differences according to sex are alsp significant in the Autumn, 
except for the Total Math score. Table 22 contains the results of this 
test. Reading is clearly the principal component which discriminates the 
sexes in the Autximn analysis, and it does so* in favor of the handicapped 
girls who score at a significantly higher grades-equivalent •lev^l than do 
the handicapped boys. These results are equivalent to the same differences, 
found between the ^exes when nonhandiaappfed students were included in the 
analysis (see Table is, p. ^9*).^. ^ 

The final significance test for the Autumn, analysis of handicapped 
Students was for the multivariate main effect of * the program factor.^ 
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Table 21 



Analy.sis 2, Autumn, 1973: Multivariate And Univariate Results And Principal 
Component Coefficients Associated Witlj Main Effect of Grade Level Factor 



Multivariate Analysis 



F 

56.102 



df 
4/299 



less than 
.001 



Univariate Analysis 
Variable 



1. Word Knowledge 

2 . Reading 

3. Total Reading, 

4. Total Math 



F(df=l/302) 

110.696 
131.720 
130.188 
225.690 



less than 

.001 
.001 
.001 
.001 



Principal Component 
.Coefficients 

.699 
.762 
.758 
.998 



Table -22 



Analysis 2, Autumn, 1973: Multivariate and Univariate Results and Principal 
Components Associated- With Main Effect of Sex Factor 



Multivariate Analysis 

♦ 

F "df 
2.754 4/299 



- ^ 



less^than •> 
.028 



Univariate Analysis 
Variable ' - 

1. Word Knowledge 

2. Readi<ng 

3. ;Total Reading 

4. Total "Math. 



F(df=2/302)_. 

5.524 
8.385 
7.563 
• 1.JJ16" 



less than 

.019 
.004 ' 
.006^ 
. 252 ' 




jincipal Component 
Coefficients ^ 

.705 
.868 
.824. 
.344 
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Table 23 reports .these results. There it can be seen that none of the F 
tests for the four variables reached significance. 

However, because the multivariate F is significant, a multivariate 
dimension is provided on which the program group can be maximally differ- 
entiated. This dimension ^s perhaps, best labeled as "Total Math." Again, 
It is the handicapped students associated with" the stratistician progreim 
who are maximally different from students in the other two groups, largely 
because they have the 'lowest Total Math grade 'equivalent score mean. 



Table 23 

Analysis 2, Auttmin, 1971: Multivariate and Univariate Results apd Principal 
^ Component Coefficients Associat;ed With Main Effect of Program 



Multivariate Analysis 



F 


- . df 


v 


P 

less than 


2.138 


8/598 




.031 . . 


Univariate Analysis 












p 


Prirrcipal Component 


Variable 


F(df=2/30i) 


less than 


Coefficients' 


1. Word Knowledge 


.168 


.845 


.168 


2. Reading 


.056 


.946 


-.013 


3.- Total Reading 


.141 


.869 


.127 


A. Total Math 


2.283 


.104 


.610 
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Spring, 1974 , The analysis of the handicapped students' achievement 
test scores for the-^Spring administration yielded po significant F ratios 
for any of the design . factors or combinations. As we have seen, this does 
not mean, that these students did not increase their Spring scores over the 
previous Autumn. Rather, it meaqs that ^the differences which do occur at 
the Spring measurement period do not reach statistical significance when 
the students are equated in tems of their Autumn scores. In this way 
then, it is not the case that th^se design .factors are associated with 
evidence that some }>andicapped students make significantly gt'^ter achieve- 
ment test score gains than oti;ers from Autumn tp Spring; i.e., gains in 
test sconces are not seen to be due to a significant effect of grade level, 
sex, or special education program ^pe. In a statistical sense, there is 
considerably less variance for the Spring analysis as indicated by the 
considerable reduction in tJae/size of the standard deviations for each of 
the four achievement test variables compared with their corresponding 
standard deviations for the Autumn analysis. ' This is partly due to the 
inclusion of the previous Autumn test scores as covariates which deliber- 
ately "restr^.cts". some of the variatipn in these Spring test scores. Never- 
theless, there ^is not enough gain in Spring test score performance to offset 
the attempt at controlling the presumed effects on that performance of 
previous knowledge ^s measured during the preceding Autumn. 

. Discussion and Sumrfiary 

o 

Again, the initial signif icant'^dif ferences among handicapped stu- 
dents on Reading, Total Reading and Total Math in the Autumn according to . 

♦ 

their program type, sex and even grade level are not large enough to sustain 
these same effects in the Spring. By contrast,^, initial Autumn differences 
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between handicapped and nonhandicapped students on Total Reading and Total 
Math are sufficiently, large and remain so in the Spring so that the effects 
of handicapped status and grade level remain as significant devices for 
differentiation among these students. Thus, when the amount of gain in 
handicapped student achievement test scores is examined in relation to the 
student's sex, grade level and special education program type, these ^clas- 
sification devices do not discriminate among* the handicapped students. 

It is to be noted, however, that these same oLassification factors 
are useful when the dependent or criterion measures are the social-emotional 
scales reported above. Certain of these measures which reflect significant^ 
differences in the Autumn retain their discriminating power in the following 
Spring. This is particularly true for 1) teacher ratings of Needs Super- 
vision (#1), and Anxiety-Depre'ssion (#4); 2) for students' self-evaluations 
of'^Loneliness, Rejection (#5), Does Well in School (#7); and 3) for stu- 
dents' perceptions of qlassroorft Climate regarding Cognitive Emphasis (#11), 
and Variety, Individualization (#12). Where the effects of program type 
are noticeable among handicapped students it' is primarily in terms of their 
perceptions of Classroom Climate and their self-evaluations \n relation to ^ 
the school situation for Loneliness; Rejection (#5) and Perceived Cognitive 
, Empahsis (#11) t Interestingly, teacher ratings provide discrimination in 
connection with grade level and sex, but only for Misbehavior and Anxiety- • 
Depression. 

The across-time effects of spfecial education program type were seen 
to be interactive with the grade Jkfl7el and sex factors for the social-emotional 
scales, but to be nonsil^twH^ <for differences ip the achievement 

test scores. Specifically, the presence of augmenting effects of the • 
stratistician program on the achievement test scores of handicapped students 
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are not to be discerned in these data^ althoxigh the differential effects 
of the progtam type are seen in some of the social-emotional scales; viz., 
stfidents associated with the stratistician program are more likely to evaluate 



thems 



elves as enjoying school more, -as less lonely, as perceiving less 



classroom misbehavior and unhappiness, and more classroom cognitive emphasis, 
and vjariety and individualization. * 

The results of these analyses can be summarized according to classes 
of dejpendent variables einploved in this investigation. 

Teacher Ratings 

Teacher ratings discriminate rr.ost often between handicapped and non- 
handicapped students; and they do so in the Autumn where teachers rate handi- 
capped children as needing more s>upervision and being more outgoing/ and less 
anxious and depressGcl than .their more normal peers. However, except for: need- 
ing more supervisibn, • teacher rating^^ no^longer distinguish between these two 
groups in the Spring analysi^fi^ indicating *they did not rate handicapped stu- 
dents that much differently on the remaining three measures in the Spring. 

Teachers also rate older and younger students differently. YoungTer 
students are rated as consistently more misbehaving than older students/ and 
older students as consistently more anxious and depressed than younger stu- 
dents. Surprisingly, they never rate .younger students as needing more 
supervision than older students. 

Teachers also find ways o'f' differentially ratiing the two sexes. In 
the Autumn, boys are seen by them to need mor^ supervision and as more mis- 
behaving than girls, but these differences do not appear as si^gnificant 
for teachers when they rate again ^in the Spring, Teachers *do not find out- 

^ ^ , . _ , .... ^ ..... 

» 

G / 
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goingness, expressiveness, anxiousness or' depression -as ways of differ- 
entiating the sexes. As well, teachers' ratings, when examined with the 
various special education programs used in this study, do not provide ^ny 
discrimination among handicapped- students whatsoever. It is only when 
teachers of both types of students a2*e filling out ratings that differences 
according to handicapped or nonhandicapped can.be found. There ,^ teacher 
ratings dominate differences according to student self-image and perception 
of the classroom climate. One's student-status as. handicapped or not 
seeiTiS more pronounced for teachers than it is for students. 

■ / ■ • 

Student Sel.f-Imag^ ^, 
The student's self attributions regarding , loneliness and rejection, 
,^ enjoying school, doing well in school and misbehaving are most prominent in 
t^ms of grade-level differences. For example, younger students are more 
likely to report themselves as doing better in, school than are^older students. 
But older students are also likely to say they misbehave more than younger 
students, at least at the beginning of the school year. For handicapped 
students only, the older children also report being less lonely than the 
younger children, who in turn say they are doing better but also feel loijelier 
and more rejected. ^ , ^ 

How students describe thafittS^ss^ve s is also related to sex, where, in 
the Autumn only, girls see themselves as ienjoying school more and misbe- 
having less than the boys. These differences do not hold up when student 
responses are again examined the following Spring, except among handicapped 

7 

children where girls still enjoy school signific^tly more than boys. 

The only differences between handicapped and nonhandicapped chil- 

dren in regard to self-image across time occurs in terms of 'loneliness 

■ P . - 

' . . ' ■ . • ' 



66 ' 



and rejeqjbion. ' Ir is the nonhandicapped students who- perceive themselves 
as* being' lonelier and feeling more rejected than their handicapped peers. 

' Among 'handicar^-cu- children alone, self-image differences 'occur in 
the Autumn when ex^med m terns of special education program type. Again 
the m^^sures of dcmg well in school and of misbehaving help differentiate 
^mong students acccrdiha to rroqram type. Students in th^ Resource Room/ 
Stratistician combination program saw themselves doing less well in school, 
but also as misbenavm^. I*^s5 than students in, the other three program types 
Xhose '^if feronces, '•-owpvcr, wero not rufficiontly yreat enough to remain 
as significant di^crimir^it' r ^ a^ro^s time at the Sirring analysis. 

Student P o rter txor. of Classroon Climate 
Stu.dent pers^epnop of classroom climate regarding enjoyment, posi- 
tive reinforcement; unhapp^ness, misbehavipr; cognitive emphasis; and 
variety and individualization ^re most promx-nent m producing differences 
according to grade level. Here, correlation of classrcJom climate scores 

^_ 

dominate the na-t-jre-of all dirferences asoocxated- with this age rela ted 

factor. Student classroom clirate perceptions eff^ectively distinguish 
older from younger students in the Autumn and Spring and primarily in terms 
of older students perceiving more cognitive emphasis than younger students. 
Perceptions of ^unhappiness atid misbehavior is related primarily to sex dif- 
ferences'in the Autumn, where boys perceive more of this as characteristic 
Qf the 'classroom .than do girls. 

Cognitive emphasis, and variety and individualization discriminate 
handiqapped students according to special education program type in the 
Autumn but not m the Spring. Here, students in the stratistician-only 
program perceive the most cognitive emphasis and variety. 
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Word Knowledge ' ^ k 

The achievement test variable. Word Knowledge, effectively discrimin 
ates students i|i the Autumn according to grade level, sex and handicapped 
status where older students, handicapped girls, and nonhandicapped students 
generally achieve the higher scqres. It retains significance in thd Spring 
only foj; discriminatin9 between handicapped and nonhandicapped students. 
It does not distinguish among handicapped students according to program 
type and it never dominates the multivariate nature of these differences. 

Reading 

Like Word Knowledge, better Reading performance in the Autumn 
discriminates older frc»n younger students, girls from boys, nonhandicapped 
from handicapped students and handicapped girls from handicapped boys. ^- . 
It is effective in the Spring only in terms of handicapped status where 
the nonhandicapped students again out perform their handicapped peers. 
Reading dominates the multivariate differences for sex and handicapped 
status, but not for-grade level or program Lype. . 

• Total Reading 

Like Reading, better Total Reading performance is characteristic 
m the Autumn for older students, girls, handicapped girls and non- 
handicapped students in general. It dominates the multivariate difference 
between the handicapped and nonhandicapped students in tl^^ Spring but* not 
elsewhere. y 

* 

Total Math 

Higher Total Math performance differentiates, in the Autumn, older * 
from^^Y^^ger students, handicapped girls from handicapped boys, and non- 
handicapped from handicapped students; wherea'fe lower Total Math performance 
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differentiates these students Tn the stratistician-oniy program from stu- 
dents in tiie other two typ^^*of progra.-ns. Total Math continues to define - - 

« 

the multivariate nature of differences across time according to grade level, • 

and in the Autumn accordmc to special education program type. 

In summary, of the total of the 16 dependent variables which were 

used in this study, the following accounted for the most effective and 

consistent measures on wMch difference's were observed: a) Needs Super- 

vision, b) Anxious, Depressed, o; Loneliness, Pejection, d) Misbehavior 

(self-rated), e) Cognitive Epimsi"^, f) Variety, Individualization, g) 

Reading and h) Total Met". tne desiqr. factors employed, those which 

« 

accounted for the zi^^t viri^,r.>, -.zccrdiu-] to the size of the F ratios were: 
grade level and cia>3if -^^tion vandicapr-td or not handicapped". Pro- 
portionally less variance a*j3 accounted for' by the design factors of sex 
and program status. * 
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